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® High-Speed Noninvasive Eye-Tracking System 

This system operates at a frame rate of several kilohertz. 

NASA’s Jet Propulsion Laboratory, Pasadena, California 


The figure schematically depicts a system 
of electronic hardware and software that 
noninvasively tracks the direction of a per- 
son’s gaze in real time. Like prior commer- 
cial noninvasive eye-tracking systems, this 
system is based on (1) illumination of an 
eye by a low-power infrared light-emitting 
diode (LED); (2) acquisition of video im- 
ages of the pupil, his, and cornea in the re- 
flected infrared light; (3) digitization of the 
images; and (4) processing the digital 
image data to determine die direction of 
gaze from the centroids of the pupil and 
cornea in the images. Relative to the prior 
commercial systems, the present system op- 
erates at much higher speed and thereby 
offers enhanced capability for applications 
that involve human-computer interactions, 
including typing and computer command 
and control by handicapped individuals, 


and eye-based diagnosis of physiological 
disorders that affect gaze responses. 

Most of the prior commercial nonin- 
vasive eye-tracking systems rely on stan- 
dard video cameras, which operate at 
frame rates of about 30 Hz. In a typical 
system, the video-data stream is 
processed either in the central process- 
ing unit of a host computer or in a digi- 
tal signal processor on a frame-grabber 
board. Such a system is limited to slow, 
full-frame operation in which the bur- 
den of processing the full-frame image 
data is placed on the host computer. 

In the present system, most control 
functions and processing of image data 
are performed by firmware on an on- 
board field-programmable gate array 
(FPGA). This aspect of the design re- 
lieves the host computer of much of the 
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The Software and Hardware Architectures of this noninvasive eye-tracking system differ significantly 
from those of prior such systems in ways that enable this system to operate at much higher speeds. 


burden of transferring full-image data 
via the host bus (which is typically a slow 
operation) or the need to process the 
full image data after transfer to the host 
PC. The firmware for the FPGA is rela- 
tively easily extendable to the design of a 
compact application-specific integrated 
circuit that could be mass-produced. It is 
envisioned that with further develop- 
ment, the architecture of this system 
could progress to that of an affordable, 
portable, stand-alone computer-periph- 
eral unit similar to an optical mouse. 

Another important aspect of the design 
is an advanced control scheme for a 
charge-coupled device (CCD) image de- 
tector. The scheme provides for readout 
from a small region of interest (ROI), or 
subwindow, of the full image. Because the 
ROI contains significantly far fewer pixels 
than does the full image, one can achieve 
a high frame rate by reading out the ROI 
(but not the rest of the image) repeatedly. 
Inasmuch as the image features of interest 
(the cornea and pupil) typically occupy a 
small part of the camera frame, this ROI 
capability enables determination of the 
direction of gaze at a high rate. At pres- 
ent, commercial CCD cameras are not 
well suited to implementation of this 
scheme, and a custom camera is used in- 
stead. This camera, which has an active 
image area of 658 by 496 pixels, is capable 
of readout from an 8-by-8-pixel ROI at a 
rate of 6 kHz. 
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